Alpha desynchronization reflects prediction error in rewarded learning

نویسندگان

  • D. T. LOTZ
  • C. ELLIOTT
  • S. MAKEIG
  • T. J. SEJNOWSKI
  • H. POIZNER
چکیده

The objective of the present study was to investigate whether brain oscillations play a role in rewarded learning. Previous research has shown that alpha oscillations in ventromedial prefrontal cortex are correlated with the reward prediction error from a reinforcement learning model of a subject's choice behavior in the Iowa Gambling Task. However, the macroscopic extent of these oscillations, whether they are detectable with scalp EEG, and whether they generalize to other forms of rewarded implicit learning remains unclear. We measured 64-channel scalp EEG in seven healthy young adults while they performed a rewarded implicit learning task. On each trial, subjects were presented with a pair of abstract images associated with different probabilities of providing a fixed cash reward. Over the course of 256 trials, subjects learned to choose images that are more likely to payoff. In the subsequent phase of an additional and otherwise identical 256 trials, the reward probabilities of the images were reversed and subjects had to learn the new reward contingencies to maximize their winnings. We evaluated oscillatory dynamics in theta, alpha, and beta bands as the change in spectral power between the 500 ms before and after subjects were given each auditory reward signal. In the period immediately after the reward contingency reversal, when the prediction error from a reinforcement learning model of the behavior is strongest, the success with which subjects learned the new reward contingencies was correlated with the extent to which their alpha power decreased in frontal regions. This correlation did not exist in posterior scalp regions, consistent with an origin specific to prefrontal cortex. Furthermore, the effect was not present in theta and beta bands, suggesting that alpha oscillations in particular play a role in this form of learning. Collectively, the results suggest that alpha oscillations, including those measured at the scalp, play a role in rewarded learning. : Theme and Topic (Complete): F.01.b. Learning and long-term memory ; F.01.g. Decision making and reasoning

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning

We assessed electrophysiological activity over the medial frontal cortex (MFC) during outcome-based behavioral adjustment using a probabilistic reversal learning task. During recording, participants were presented two abstract visual patterns on each trial and had to select the stimulus rewarded on 80% of trials and to avoid the stimulus rewarded on 20% of trials. These contingencies were rever...

متن کامل

Choice modulates the neural dynamics of prediction error processing during rewarded learning

Our ability to selectively engage with our environment enables us to guide our learning and to take advantage of its benefits. When facing multiple possible actions, our choices are a critical aspect of learning. In the case of learning from rewarding feedback, there has been substantial theoretical and empirical progress in elucidating the associated behavioral and neural processes, predominan...

متن کامل

Prediction success

divided into a) error and rewarded trials and b) switch and stay trials. The effect of volatility remains even if only error trials, or only rewarded trials, or only switch trials, or only stay trials are included in the analysis.

متن کامل

Updating dopamine reward signals

Recent work has advanced our knowledge of phasic dopamine reward prediction error signals. The error signal is bidirectional, reflects well the higher order prediction error described by temporal difference learning models, is compatible with model-free and model-based reinforcement learning, reports the subjective rather than physical reward value during temporal discounting and reflects subje...

متن کامل

Context-dependent learning in honeybees: a behavioral and neural analysis

Context-dependent learning (CDL) has been shown in free flying bees and here we show similar learning in restrained bees. We took advantage of the classical learning proboscis extension response (PER) to combine behavior with extracellular recordings in alpha lobe of mushroom bodies. In one series of experiment, bees had to solve differential conditioning task under two different contexts. In o...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008